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ZOOM ALGORITHM 



5 Technical field 

This invention relates generally to image processing and relates more 
particularly to methods to zoom digital images. 

10 

Background art 



Either still images or time-varying image sequences are the input to digital 
15 imaging systems. A digital zoom capability uses algorithms and zooms in on the 
digital image in the camera. This can greatly improve the zoom capability of the 
camera and is less expensive than high-sophisticated zoom lenses, but also loses 
some image quality. The quality depends upon the algorithms used for zooming. 

20 The challenge of the designers of digital zooming systems is to achieve 

fast performing methods for zooming providing good quality images and which are 
easy to be implemented. 

There are various patents knov\/n dealing with said problems: 

25 

U. S. Patent (6,101,235 to Zavaljevski et al.) describes methods and 
apparatus for altering the spatial characteristics of a digital image collected in a 
CT system using a real-time magnification algorithm. In accordance with one 
embodiment of the algorithm, once the digital image is collected, an enlarged 
30 image is generated by interpolating and filtering the original digital image data. In 
one aspect, two pass linear interpolation and one-dimensional filtering is utilized 
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to generate the enlarged image. The first pass performs interpolation in the x 
direction and the second pass performs interpolation in the y direction. The 
interpolations in the x and y directions are perfomfied in two steps. Initially, linear 
interpolation is applied to the original digital image to generate interpolated data. 
A one dimensional convolution filter is then applied to the interpolated data. 
Utilizing this process, a high quality enlarged image may be generated for any 
integer zoom factor. In another aspect of the present Invention, a two-step 
procedure of interpolation and two-dimensional filtering is utilized. The first step 
performs bilinear interpolation of the digital Image to generate interpolated data. 
The interpolated data is then filtered by a two-dimensional convolution filter. 

U. S. Patent (5.602,870 to Hailey et al.) discloses a spatial interpolation 
unit used to alter a digital image by perfomriing a zoom operation thereon. 
Described is a spatial interpolation unit, which comprises a discrete set of filters 
for which at least some of the cut-off frequencies are logarithmically spaced. 



U. S. Patent (5,307.167 to Park et al.) describes a digital zoom system 
utilizing image buffers and employing an approximated bilinear interpolation 
method. The zoom system includes an analog-to-digital (A^) converter for 
converting an analog image signal to a digital image signal, an image buffer for 
storing the digital image signal generated for said A/D converter, a horizontal 
operatiorT circuit for" interpolating the digital- image-signal- taken along-with -a- 
horizontal direction, one or more horizontal image buffers for storing the digital 
image signal for 1-horizontal lines magnified in a horizontal direcUon. a vertical 
operation circuit for interpolating said horizontally magnified image signal In a 
vertical direction, a timing controller for controlling the image buffer, said 
horizontal and vertical operation circuits, and a digital-to-analog (D/A) converter 
for converting the digital image signal finally magnified in the horizontal and 
vertical direction back to analog image signal. 
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Summary of the invention 



A principal object of the present invention is to achieve a fast and efficient 
5 way to zoom a digital image. 

In accordance with the object of this invention a method to zoom a region 
of interest from a digital image has been achieved. Said method comprises the 
following steps: (1) define size and location of region of interest as part of source 

10 image, (2) calculate scale of conversion in x- and y-direction, (3) calculate number 
of rows of pixels of destination image according to scale of conversion desired in 
y-direction, (4) calculate number of pixels contained in a row of pixels of 
destination image according to scale of conversion desired in x-direction, (5) 
calculate color values of each pixel along the rows of pixels of the destination. 

15 image by interpolation from nearest row of pixels of source image, and (6) display 
zoomed region of interest in destination image. 

In accordance with the object of this invention another method to zoom a 
region of interest from a digital image has been achieved. Said method comprises 

20 the following steps: (1) define size and location of region of interest as part of 
source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate 
number of columns of pixels of destination image according to scale of conversion 
desired in x-direction, (4) calculate number of pixels contained in a column of 
pixels of destination image according to scale of conversion desired in y-direction, 

25 (5) calculate color values of columns of pixels of destination image by 
interpolation from nearest column of pixels of source image, and (6) display 
zoomed region of interest in destination image. 

In accordance with the object of this invention another method to zoom a 
30 region of interest from a digital image has been achieved. Said method comprises 
the following steps, first: (1 ) define size and location of region of interest as part of 
source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate 
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number of rows of pixels of destination image according to scale of conversion 
desired in y-direction, and (4) calculate number of pixels contained in a row of 
pixels of destination image according to scale of conversion desired in x-direction. 
Furthermore the method invented comprises the steps: (5) calculate x. y virtual 

5 starting point of destination pixel for each frame, (6) calculate virtual location of 
first destination pixel for new row in x-direction and interpolate new color values of 
color space of said first destination pixel from nearest source pixels located ^t 
nearest row of source pixels in y-directlon, (7) calculate virtual position of next 
destination pixel in x-directlon according to scale factor and interpolate new color 

10 values of color space used of said next pixel from nearest source pixels located at 
nearest row of source pixels in y-direction, (8) go to next step (8) if last destination 
pixel in x-direction has been reached othenwise go to step (6), (9) go to step (11) if 
last row of destination pixels has been reached othenwise go to next step (9), (10) 
calculate virtual location of next row in y-direction according to scale factor in y- 

15 direction and go to step (5), and (11) display zoomed region of interest in 

destination image. 

In accordance with the object of this invention another method to zoom a 
region of interest from a digital image has been achieved. Said method comprises 

20 the following steps, first: (1) define size and location of region of interest as part of 
source image, (2) calculate scale of conversion in x- and y-direction, (3) calculate 
number of columns of pixels of destination image according to scale of conversion 
_desired in x-dijection, (4) calculate number of pixels contained m a column of 
pixels of destination image according to scale of conversion desired in y-direction, 

25 and (5) calculate x, y virtual starting point of destination pixel for each frame. 
Furthermore the method invented comprises the steps: (6) calculate virtual 
location of first destination pixel for new column In y-direction and interpolate new 
color values of color space of said first destination pixel from nearest source 
pixels located at nearest column of source pixels in x-direction, (7) calculate 

30 virtual position of next destination pixel in y-direction according to scale factor and 
interpolate new color values of color space used of said next pixel from nearest 
source pixels located at nearest column of source pixels in x-direction, (8) go to 
next step (8) if last destination pixel in y-direction has been reached othenwise go 
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to step (6), (9) go to step (11) if last column of destination pixels has been 
reached otherwise go to next step (9), (10) calculate virtual location of next 
column in x-direction according to scale factor in x-direction and go to step (5). 
and (11) display zoomed region of interest in destination image. 

5 

Description of the drawings 

in the accompanying drawings forming a material part of this description, 
10 there is shown: 

Fig. 1 shows the major components of zooming of a digital image. 

Fig. 2 shows a flowchart of a method how to zoom a digital image. 

15 

Fig. 3 shows a detailed flowchart of a method how to zoom a digital image. 
Description of the preferred embodiments 

20 

The preferred embodiments disclose a novel method to zoom digital 
images. Said method is based on the methods to convert the resolution of digital 
images disclosed with European patent application (docket number DS03-025) , 

25 entitled "Image Resolution Conversion" filed March 30^ 2004 and assigned to 
the same assignee as the present invention. In order to be able to use said 
methods to convert the resolution for zooming the region of interest of the source 
image has to be defined prior to a change of resolution and the offsets have to be 
defined in a special way. The methods of the present invention apply to video 

30 images as well as to still images of a digital camera. 
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Fig. 1 shows the basic components of digital zooming. Theire Is a source 
image 1. a region of interest (area to be zoomed) 2, and a destination image 3. 
Said destination image 3 has a fixed size. The region of interest 2 has a shape of 
a rectangle and is defined by e.g. the coordinates xuc. yuc of the upper left comer, 

5 the length xie in x-direction and the width yw in y-direction. These parameters xuc,. 
yuc, xie. and yw are variables and define the zooming factors in x- and y-direction 
compared to the fixed rectangular size of the destination image 3 having a fixed 
length xf and fixed width yr. Other parameters to define the region of interest are 
possible as well. e.g. the coordinates of corners of the rectangle being located 

10 diagonally to each other. The resolution of the region of interest is either 
decimated or enlarged to fit into the destination image. The destination Image 3 
can be larger or smaller than the region of interest 2. depending upon the 
zooming factors in x- and y-directlon. 

Other shapes than rectangles for the region of interest and for the 
15 destination image, e.g. circles, are possible as well. Using rectangles is the 
simplest way to achieve zooming. 

The methods invented apply to video images as well to still images of a 
digital camera. 

20 The flowchart of Fig. 2 shows the principal steps of a method to zoom a 

-digital-image. The first step 21 describes the definitkin^ of the size and location of 
the region of interest, in other words of the area to be zoomed. In a preferred 
embodiment said definition is perfomied according to the example shown in Fig. 
1, using the coordinates xuc, yuc of the upper left comer of the region of interest. 

25 its length xie in x-direction and its width yw in y-direction. Another alternative to 
define the size and location of the region of interest could be to define the location 
of two corners, being located diagonally to each other as e.g. the upper left comer 
and the location of the bottom right comer and calculate the length and the width 
of the region of interest using the coordinates of these two comers. Many more 
30 definitions are possible. The following steps 22 - 26 follow the methods of 
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conversion of the resolution of digital images as disclosed in the above referenced 
European patent application (docket number DS03-025) 

Said methods describe a very fast and simple way to decrease or to 
5 . increase the resolution of digital images and still maintain an acceptable quality of 
the images. In case of a decimation of the resolution of a digital image the method 
invented comprises a combination of using simultaneously two different 
procedures, first, a decimation filter, or interpolation, along one coordinate to 
calculate the color values of the destination pixels and, second, omitting some 
10 rows of source pixels along the other coordinate of an image according to the 
scale of conversion. In case of an increase of the resolution of a digital image the 
method invented comprises a similar combination of procedures, first, an 
interpolation of source pixels to calculate the color values of the increased number 
of destination pixels, second, an extrapolation of the color values of the 
15 destination pixels being very close to the edges of the destination image, and, 
third, a replication of rows of the destination image to gain additional rows of' 
destination pixels according to the scale of enlargement. 

Step 22 of the flowchart of Flg.2 describes the calculation of the scale of 
conversion in x- and y- direction from the region of interest to get the destination 
image. The scale of conversion is calculated in x-direction using the following 
equation: 

offsetx 

Xf 

wherein offsetx is the scale of decimation in x-direction, Xle is the length of 
the region of interest, and Xf is the fixed length of the destination image (as 
shown in Fig. 1). The scale of conversion is calculated in y-direction using the 
following equation: 

offsety^—, 

wherein offsety is the scale of decimation in y-direction, Yw is the width of 
the region of interest, and Yf is the fixed width of the destination image (as shown 
in Fig. 1). Step 23 describes the calculation of number of rows of pixels of the 
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destination image according to scale of conversion desired in y-direction and 
calculated in the previous step. In case of decimation of the region of interest 
some rows of the region of interest will be omitted, in case of enlargement 
additional rows will be replicated. In the next step 24 the number of pixels 

5 contained in a row of pixels of the destination image is calculated according to the 
scale of conversion desired m x-direction and calculated in step 22. The following 
step 25 comprises the calculation of the color values of each pixel along the rows 
of pixels of the destination image by interpolation from nearest row of the source 
image (region of interest). The last step 26 comprises the display of the zoomed 

10 region of interest in destination image. 

Fig. 3 describes in more details a method of the present Invention to zoom 
a digital image. The first step 300 describes the definition of the size and location 
of the region of interest, in other words of the area to be zoomed. In a preferred 

15 embodiment said definition is performed according to the example shown in Fig. 
1, using the coordinates xuc, yuc of the upper left corner of the region of interest, 
Its length xie in x-direction and its width yw in y-direction. Another alternative to 
define the size and location of the region of interest could be to define the location 
of the upper left corner and the location of the bottom left corner and calculate the 

20 length and the width of the region of interest using the coordinates of these two 
comers. Many more definitions are possible. The following steps 301 - 309 follow 
the methods of conversion of the resolution of digital images as disclosed in the 
above referenced-European patent application (docket_number DS03-025) filed 
March 30*'' 2004. Step 301 of said method comprises the calculation of the scale 

25 of conversion in x- and y-direction. Using the example shown in Fig. 1, the scale 
of conversion offsetx is in x-direction is 

Xf 

wherein Xue is the length of the region of interest, and Xf is the fixed length of the 
destination image (as shown in Fig. 1). The scale of conversion is calculated in y- 
30 direction using the following equation: 
Yw 

offsety^—. 
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wherein offsety is the scale of conversion in y-direction, Yw is the width of 
the region of interest, and Yf is the fixed width of the destination image (as shown 
in Fig. 1). The next step 302 comprises the calculation of number of rows of pixels 
of the destination image according to the scale of conversion desired in y- 

5 direction. The following step 303 describes the calculation of the number of pixels 
contained in a row of pixels of the destination image according to the scale of 
conversion required in x-direction. The following step 304 comprises the 
calculation of the x, y coordinates of the virtual starting point of destination pixels 
for a new frame. Said starting point, which is the middle of the first pixel, is 

10 calculated using the conversion scales calculated in the previous step. The 
location of the starting point calculated is a 'Virtual" location; it is used for 
interpolation only. It does not describe the actual physical location of the 
destination pixel. The "virtuar distance distlx of the middle of the first pixel from 
the edge of the image in x-directions is: 

15 distlx = offsetx x pixelwidthx/2, 

wherein offsetx is the scale of conversion of the resolution in x-direction calculated 
in step 301, pixelwidthx is the width of a source pixel in x-direction. The distance 
distly of the middle of the first pixel from the edge of the image in y-directions Is: 
distly = offsety4/2 x pixelwidthy/2, 

20 wherein offsety is the scale of conversion of the resolution in y-direction calculated 
in step 301, pixelwidtfiy is the width of a source pixel in y-direction. Usually the 
pixelwidth of a source image is identical in x- and y-direction. As explained above 
said distance distly is used to locate and identify the nearest row of pixels of the 
source image and distance distlx is used to locate the nearest pixels of said 

25 nearest row of the source image for the purpose of interpolation in x-direction. In 
step 305 the starting point of the first destination pixel in x-direction for a new row 
and the color values of said first pixel of a new row of the destination image are 
calculated. The number of color values to be calculated depends upon the color 
space used. The calculation of the starting, point of step 305 is identical to the 

30 calculation used in step 304. Furthermore the color values of the first pixel of a 
new row of the destination image are calculated by inteipolation. In a preferred 
embodiment a linear interpolation of the color values of the two nearest pixels of 
the source image has been used. All color values of the color space used get 
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interpolated to define the colors of the first pixel of a new row of the destination 
image. The color space used could be e.g. RGB, YcbCr, YUV or any other color 
space comprising three or more colors. 

5 In case YUV color space Is used luminance would be handled the same 

way as chrominance. Any polynomial of nth order could be used for interpolation, 
although order 0 (taking the color value of the nearest pixel) and order 1 (linear 
interpolation of the color values of the nearest two pixels) are the simplest 
polynomials to be used. In a preferred embodiment an interpolation of order 1 is 

10 used with the exception of pixels of the destination image having a virtual position 
between the first, or most left-sided, pixel of the nearest row of the source image 
and the left side edge of the image or correspondingly between the last, or most 
right-sided, pixel of the nearest row of the source image and the right-side edge of 
the image. For these "peripheral" pixels an interpolation of the order 0 Is used, this 

15 means the first, or correspondingly, the last pixel of the nearest row of the source 
image is replicated. 

In case of enlargement, neighboring pixels outside the region of interest 
can be used altematively in order to enable an interpolation of order 1 for the 
20 peripheral pixels of the region of interest, thus achieving a better quality at the 
border of the destination image.. 

In the-foUowlng_step_3P6 the "yirtuaf position of the next destination pixel 

in x-direction of the current y-line according to the scale factor is calculated as 
25 described above, and the correspondent color values of all colors of the color 
space used are calculated by an interpolation of the con-espondent color values of 
the nearest source pixels. 

The next step 307 checks if the last pixel location in the current y-line of the 
30 destination imaged has been reached, in case the last pixel location has not been 
reached the process flow goes back to step 306 and the next "virtual" location is 
calculated and the correspondent color values are interpolated. In case the last 
destination location in x-direction has been reached the process flow goes to step 
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308. Step 308 checks if the last row in y-direction has been reached. In case the 
last row in y-direction has been reached the resolution of the source Image has 
been successfully converted and the process flow goes to the last step 310. In 
case the last row in y-direction has not yet reached, the process flow goes to step 
5 309 wherein the "virtual" position of the next row in y-direction of the destination 
image is calculated and then the process flow goes back to step 305 wherein the 
tocation of the first pixel of the new y-row of the destination image and the 
correspondent color values of said pixel line are calculated. Step 310 describes 
the display of the zoomed region of interest in the destination image. 

It is obvious to those skilled in art that rows and columns could be 
interchanged as well. This means that the interpolation, described above could be 
performed also in y-directlon from the nearest column of the source image. 

15 
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Claims 



1. A method to zoom a region of interest from a digital image comprises tlie 
following steps: 

(1) define size and location of region of interest as part of source image; 

(2) calculate scale of conversion in x- and y-direction; 

(3) calculate number of rows of pixels of destination image according to 
scale of conversion desired in y-direction; 

(4) calculate number of pixels contained in a row of pixels of destination 
image according to scale of conversion desired in x-directron; 

(5) calculate color values of each pixel along the rows of pixels of the 
destination image by interpolation from nearest row of pixels of source image; and 

(6) display zoomed region of interest in destination image. 

2. A method to zoom a region of interest from a digital image comprises the 
following steps: 

(1) define size and location of region of interest as part of source image; 

(2) calculate scale of conversion in x-and y-direction; 

(3) calculate number of columns of pixels of destination image according to 
scale of conversion desired in x-direction; 

(4) calculate number of pixels contained in a column of pixels of destination 
image according to scale of conversion desired in y-direction; 

(5) calculate color values of columns of pixels of destination image by 
interpolation from nearest column of pixels of source image; and 

(6) display zoomed region of interest in destination image. 

3. The method of claim 2 wherein the color values of the pixels of the destination 
image being located between the upper side edge of the image and the first pixel 
of the nearest column of pixels of the source image and the color values of the 
pixels of the destination image being located between the bottom side edge of the 
image and the fast pixel of the nearest column of the source image are achieved 
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by replicating the color values of said first, or correspondingly said last, pixel of 
the nearest column of the source image. 

4. A method to zoom a region of interest from a digital image comprises the 
5 following steps: 

(1) define size and location of region of interest as part of source image; 

(2) calculate the scale of conversion of the resolution in x-and y-direction; 

(3) calculate number of rows of pixels of destination image according to 
scale of conversion desired in y-direction; 

10 (4) calculate number of pixels contained in a row of pixels of destination 

image according to scale of conversion desired in x-direction; 

(5) calculate x, y virtual starting point of destination pixel for each frame; 

(6) calculate virtual location of first destination pixel for new row In 
x-direction and interpolate new color values of color space of said first 

15 destination pixel from nearest source pixels located at nearest row of source 
pixels in y-directlon; 

(7) calculate virtual position of next destination pixel in x-direction 
according to scale factor and interpolate new color values of color space used of 
said next pixel from nearest source pixels located at nearest row of source pixels 

20 in y-direction; 

(8) go to next step (8) if last destination pixel in x-direction has been 
reached otherwise go to step (6); 

(9) go to step (11) if last row of destination pixels has been reached 
otherwise go to next step (9); 

25 (10) calculate virtual location of next row in y-dlrection according to scale 

factor In y-direction and go to step (5); and 

(11) display zoomed region of interest In destination image. 

5. The method of anyone of claims 1 , 2 or 4 wherein a linear Interpolation method 
30 has been used. 

6. The method of claim 1 or 4 wherein the color values of the pixels of the 
destination image being located between the left side edge of the image and the 



DS03-026 



13 



first pixel of the nearest row of pixels of the source image and the color values of 
the pixels of the destination image being located between the right side edge of 
the image and the last pixel of the nearest row of the source Image are achieved 
by replicating the color values of said first, or correspondingly said last, pixel of 
5 . the nearest row of the source Image. 

7. The method of anyone of claims 1 , 2 or 4 wherein the color values of the pixels 
of the destination image being located between the left side edge of the image 
and the first pixel of the nearest row of pixels of the region of interest of the source 

10 image and the color values of the pixels of the destination image being located 
between the right side edge of the image and the last pixel of the nearest row of 
the source image are achieved by interpolating the color values of said first, or 
correspondingly said last, pixel of the nearest row of the source image with a 
neighboring pixels outside the region of interest of the source image. 

15 . • 

8. The method of anyone of claims 1 , 2 or 4 wherein said digital image is a color 
image using any color space. 

9. The method of claim 8 wherein said color space is a R-G-B color space. 

20 

10. The method of claim 8 wherein said color space is an YCbCr color space. 

11. The method of anyone of claims 1, 2 or 4 wherein said digital image is a video 
image. 

25 

12. The method of anyone of claims 1, 2 or 4 wherein said digital image is a still 
image from a digital camera. 

13. The method of anyone of claims 1, 2 or 4 wherein said method invented is 
30 used to convert the resolution of the region of interest in any direction. 

14. The method of anyone of claims 1, 2 or 4 wherein said region of interest has 
the shape of a rectangle. 
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1 5. The method of anyone of claims 1 , 2 or 4 wherein said destination image has 
the shape of a rectangle. 

16. The method of anyone of claims 1, 2 or 4 wherein said method invented is. 
implemented using one common software program. 



15 



17. A method to zoom a region of interest from a digital image comprises the 
following steps: 

(1) define size and location of region of interest as part of source image; 

(2) calculate the scale of decimation in x-and y-dlrection; 

(3) calculate number of columns of pixels of destination image according to 
scale of conversion desired in x-direction; 

(4) calculate number of pixels contained in a column of pixels of destination 
image according to scale of conversion desired in y-direction; 

(5) calculate x, y virtual starting point of destination pixel for each frame; 

(6) calculate virtual location of first destination pixel for new column in 
y-direction and interpolate new color values of color space of said first 

destination pixel from nearest source pixels located at nearest column of source 

20 pixels in x-direction; 

(7) calculate virtual position of next destination pixel in y-dii-ection 
according to scale factor and interpolate new color values of color space used of 
said next-pixel from nearest source pjxels located at nearest column of source 
pixels in x-direction; 



25 
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(8) go to next step (8) if last destination pixel in y-direction has been 

reached othenwise go to step (6); 

(9) go to step (11) if last column of destination pixels has been reached 

othenwise go to next step (9); 

(10) calculate virtual location of next column in x-direction according to 

scale factor in x-direction and go to step (5); and 

(11) display zoomed region of interest in destination image. 
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ABSTRACT 



5 - Methods to zoom a region of interest from a digital image have been 
achieved. The methods invented support according to the scale of zooming 
the decrease or the increase of the resolution of digital images. The region of 
interest to be zoomed is variable; the destination image has a fixed size. In 
case of a decrease of the resolution of the region of interest the method 

10 invented combines interpolating source pixels to calculate the color values of 
the destination pixels and omitting some rows of source pixels. In case of 
enlargement the method invented combines interpolation of the source pixels 
to calculate the color values of the destination pixels, extrapolation of the 
destination pixels being close to the edge of the image, and replication of 

15 some of the interpolated rows of the destination image to gain additional rpws 
according to the scale of the increase of resolution (enlargement) of a digital 
image. 

20 Fig. 2 ; 
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DefiuB a%zB vsnd location of region of interest as 
port of source image 
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Calculate the scale of conversion in z- and y 

direction 
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Calculate number of rows of pixels of destination 
image according to scale of conversion required in 

ydirectimi 
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Calculate number of pixels contained in a raw of 
pixels of destination image according to scale of 
conversion required in z-direction 
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Calculate x»y coordinates of the virtual startii^g 
point of destination pixels for each frame 
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Calculate virtual location of first destination pixel 
of new raw in x-direction and interpolate new 
color values of said destination pixel from nearest 
source pixels located on nearest raw in y- 
direction of source pixels 
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Calculate virtwl position of next destination pixel 
in X'-direction according to scale factor and 
interpolate new color values of said destination 
pixel value from nearest source pixels located on 
nearest row in y-^irection of source pixels 
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